User interface apparatus for vehicle and vehicle

ABSTRACT

A user interface apparatus for a vehicle including an interface unit; a display; a camera configured to capture a forward view image of the vehicle and a processor configured to display a cropped area of the forward view image on the display in which an object is present in displayed cropped area, display a first augmented reality (AR) graphic object overlaid onto the object present in the displayed cropped area, change the cropped area based on driving situation information received through the interface unit, and change the first AR graphic object to a second AR object based on the driving situation information.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the priority benefit of Korean PatentApplication No. 10-2017-0094280, filed on Jul. 25, 2017 in the KoreanIntellectual Property Office, the disclosure of which is incorporatedherein by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a user interface apparatus for vehicle,and a vehicle.

2. Description of the Related Art

A vehicle is an apparatus that moves in a direction desired by a userriding therein. A representative example of a vehicle may be anautomobile. Recently, vehicles have been equipped with various types ofsensors and electronic devices for convenience of a user. In particular,Advance Driver Assistance Systems (ADASs) are under study to improvedriver convenience. In addition, efforts have been being made to developan autonomous vehicle.

Recently, a user interface apparatus for a vehicle has been developed todisplay an augmented reality (AR) graphic object on a display. Toimplement augmented reality, it is necessary to acquire and use aforward view image.

However, a forward view image of the same area forward of a vehicle isoutput despite of a change in movement of the vehicle, and an AR graphicobject may not match with the forward view image. As a result, it is notpossible to provide a user with accurate information.

SUMMARY OF THE INVENTION

The present invention has been made in view of the above problems, andit is one object of the present invention to provide a user interfaceapparatus for a vehicle, which outputs an augmented reality (AR) graphicobject in a flexible manner in response to a change in movement of thevehicle.

It is another object of the present invention to provide a vehicleincluding the user interface apparatus.

Objects of the present invention should not be limited to theaforementioned objects and other unmentioned objects will be clearlyunderstood by those skilled in the art from the following description.

In accordance with an embodiment of the present invention, the above andother objects can be accomplished by the provision of a user interfaceapparatus for a vehicle, including: an interface unit, a display, acamera configured to capture a forward view image, and a processorconfigured to: receive information about an object located ahead of thevehicle through the interface unit; crop a part of the forward viewimage; control the display to overlay an augmented reality (AR) graphicobject, corresponding to an object present in a crop area of the forwardview image, on an image of the crop area of the forward view image;change the crop area based on driving situation information receivedthrough the interface unit; and control the display based on the drivingsituation information to change the AR graphic object.

The details of other embodiments are included in the followingdescription and the accompanying drawings.

The embodiments of the present invention have one or more advantages asfollows.

First, by changing a crop area appropriately in response to a change inmovement of a vehicle, it is possible to provide an image suitable for adriving situation.

Second, by using an AR graphic object, it is possible to provideaccurate information of which an occupant needs to be informed dependingon a driving situation.

Effects of the present invention should not be limited to theaforementioned effects and other unmentioned effects will be clearlyunderstood by those skilled in the art from the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments will be described in detail with reference to thefollowing drawings in which like reference numerals refer to likeelements wherein:

FIG. 1 is a view illustrating the external appearance of a vehicleaccording to an embodiment of the present invention;

FIG. 2 includes different angled views of the external appearance of avehicle according to an embodiment of the present invention;

FIGS. 3 and 4 are views illustrating the interior configuration of avehicle according to an embodiment of the present invention;

FIGS. 5 and 6 are views for explanation of an object according to anembodiment of the present invention;

FIG. 7 is a block diagram illustrating a vehicle according to anembodiment of the present invention;

FIG. 8 is a block diagram illustrating a user interface apparatus forvehicle according to an embodiment of the present invention;

FIG. 9 is a flowchart of a user interface apparatus according to anembodiment of the present invention;

FIG. 10 is a diagram illustrating a crop operation according to anembodiment of the present invention;

FIGS. 11A and 11B are diagrams illustrating an operation of a userinterface apparatus according to an embodiment of the present invention;

FIGS. 12A and 12B are diagrams illustrating an operation of a userinterface apparatus according to an embodiment of the present invention;

FIGS. 13A and 13B are diagrams illustrating an operation of a userinterface apparatus according to an embodiment of the present invention;

FIG. 14 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present disclosure;

FIG. 15 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention;

FIG. 16 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention;

FIG. 17 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention; and

FIG. 18 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Hereinafter, the embodiments disclosed in the present specification willbe described in detail with reference to the accompanying drawings, andthe same or similar elements are denoted by the same reference numeralseven though they are depicted in different drawings and redundantdescriptions thereof will be omitted. In the following description, withrespect to constituent elements used in the following description, thesuffixes “module” and “unit” are used or combined with each other onlyin consideration of ease in the preparation of the specification, and donot have or serve as different meanings. Accordingly, the suffixes“module” and “unit” may be interchanged with each other. In addition,the accompanying drawings are provided only for a better understandingof the embodiments disclosed in the present specification and are notintended to limit the technical ideas disclosed in the presentspecification. Therefore, it should be understood that the accompanyingdrawings include all modifications, equivalents and substitutionsincluded in the scope and sprit of the present invention.

Although the terms “first,” “second,” etc., may be used herein todescribe various components, these components should not be limited bythese terms. These terms are only used to distinguish one component fromanother component.

When a component is referred to as being “connected to” or “coupled to”another component, it may be directly connected to or coupled to anothercomponent or intervening components may be present. In contrast, when acomponent is referred to as being “directly connected to” or “directlycoupled to” another component, there are no intervening componentspresent.

As used herein, the singular form is intended to include the pluralforms as well, unless the context clearly indicates otherwise. In thepresent application, it will be further understood that the terms“comprises”, includes,” etc. specify the presence of stated features,integers, steps, operations, elements, components, or combinationsthereof, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components, orcombinations thereof.

A vehicle as described in this specification includes an automobile anda motorcycle. Hereinafter, a description will be given based on anautomobile. A vehicle as described in this specification includes all ofan internal combustion engine vehicle including an engine as a powersource, a hybrid vehicle including both an engine and an electric motoras a power source, and an electric vehicle including an electric motoras a power source.

In the following description, “the left side of the vehicle” refers tothe left side in the forward driving direction of the vehicle, and “theright side of the vehicle” refers to the right side in the forwarddriving direction of the vehicle.

Referring to FIGS. 1 to 7, a vehicle 100 includes a plurality of wheelsrotated by a power source, and a steering input device 510 forcontrolling a driving direction of the vehicle 100.

The vehicle 100 may be an autonomous vehicle and switch to an autonomousdriving mode or a manual mode in response to a user input. For example,in response to a user input received through a user interface apparatus200, the vehicle 100 can switch from a manual mode to an autonomousdriving mode, or vice versa.

The vehicle 100 can switch to the autonomous driving mode or to themanual mode based on driving situation information. The drivingsituation information may include at least one of the following:information on an object located outside the vehicle 100, navigationinformation, and vehicle state information.

For example, the vehicle 100 can switch from the manual mode to theautonomous driving mode, or vice versa, based on driving situationinformation generated by the object detection apparatus 300. The vehicle100 can also switch from the manual mode to the autonomous driving mode,or vice versa, based on driving situation information received through acommunication apparatus 400.

In addition, the vehicle 100 can switch from the manual mode to theautonomous driving mode, or vice versa, based on information, data, anda signal provided from an external device. When the vehicle 100 operatesin the autonomous driving mode, the autonomous vehicle 100 can operatebased on a vehicle travel system 700.

For example, the autonomous vehicle 100 can operate based oninformation, data, or signals generated by a driving system 710, aparking-out system 740, and a parking system 750. While operating in themanual mode, the autonomous vehicle 100 can receive a user input fordriving of the vehicle 100 through a driving manipulation apparatus 500.In response to the user input received through the driving manipulationapparatus 500, the vehicle 100 can operate.

The term “overall length” means the length from the front end to therear end of the vehicle 100, the term “overall width” means the width ofthe vehicle 100, and the term “overall height” means the height from thebottom of the wheel to the roof. In the following description, the term“overall length direction L” may mean the reference direction for themeasurement of the overall length of the vehicle 100, the term “overallwidth direction W” may mean the reference direction for the measurementof the overall width of the vehicle 100, and the term “overall heightdirection H” may mean the reference direction for the measurement of theoverall height of the vehicle 100.

As illustrated in FIG. 7, the vehicle 100 may include the user interfaceapparatus 200, the object detection apparatus 300, the communicationapparatus 400, the driving manipulation apparatus 500, a vehicle driveapparatus 600, the vehicle travel system 700, a navigation system 770, asensing unit 120, an interface 130, a memory 140, a controller 170, anda power supply unit 190. The vehicle 100 may further include othercomponents in addition to the aforementioned components, or may notinclude some of the aforementioned components.

The user interface apparatus 200 is provided to support communicationbetween the vehicle 100 and a user. The user interface apparatus 200 canreceive a user input, and provide information generated in the vehicle100 to the user. The vehicle 100 can also enable User Interfaces (UI) orUser Experience (UX) through the user interface apparatus 200.

As shown, the user interface apparatus 200 may include an input device210, an internal camera 220, a biometric sensing unit 230, an outputdevice 250, and a processor 270. The user interface apparatus 200 mayfurther include other components in addition to the aforementionedcomponents, or may not include some of the aforementioned components.

In addition, the input device 210 is configured to receive informationfrom a user, and data collected in the input device 210 can be analyzedby the processor 270 and then processed into a control command of theuser. The input device 210 may be disposed inside the vehicle 100. Forexample, the input device 210 can be disposed in a region of a steeringwheel, a region of an instrument panel, a region of a seat, a region ofeach pillar, a region of a door, a region of a center console, a regionof a head lining, a region of a sun visor, a region of a windshield, ora region of a window.

The input device 210 may include a voice input unit 211, a gesture inputunit 212, a touch input unit 213, and a mechanical input unit 214. Thevoice input unit 211 can convert a voice input of a user into anelectrical signal. The converted electrical signal can then be providedto the processor 270 or the controller 170. The voice input unit 211 mayalso include one or more microphones.

The gesture input unit 212 can convert a gesture input of a user into anelectrical signal. The converted electrical signal can then be providedto the processor 270 or the controller 170. The gesture input unit 212may include at least one of an infrared sensor and an image sensor forsensing a gesture input of a user.

The gesture input unit 212 can sense a three-dimensional (3D) gestureinput of a user. Thus, the gesture input unit 212 may include aplurality of light emitting devices for outputting infrared light, or aplurality of image sensors. The gesture input unit 212 can sense a 3Dgesture input by employing a Time of Flight (TOF) scheme, a structuredlight scheme, or a disparity scheme.

The touch input unit 213 can convert a user's touch input into anelectrical signal. The converted electrical signal can then be providedto the processor 270 or the controller 170. The touch input unit 213 mayinclude a touch sensor for sensing a touch input of a user.

In addition, the touch input device 210 may be formed integral with adisplay 251 to implement a touch screen. The touch screen provides aninput interface and an output interface between the vehicle 100 and theuser.

The mechanical input unit 214 may include at least one of a button, adome switch, a jog wheel, and a jog switch. An electrical signalgenerated by the mechanical input unit 214 may be provided to theprocessor 270 or the controller 170. The mechanical input unit 214 maybe located on a steering wheel, a center fascia, a center console, acockpit module, a door, etc.

The internal camera 220 can acquire images of the inside of the vehicle100. The processor 270 can sense a user's condition based on the imagesof the inside of the vehicle 100. The processor 270 can also acquireinformation on an eye gaze of the user. Further, the processor 270 cansense a gesture of the user from the images of the inside of the vehicle100.

The biometric sensing unit 230 can acquire biometric information of theuser. The biometric sensing unit 230 may include a sensor for acquirebiometric information of the user, and can utilize the sensor to acquirefinger print information, and heart rate information of the user. Thebiometric information may also be used for user authentication.

The output device 250 generates a visual, audio, or tactile output andmay include at least one of a display 251, a sound output unit 252, anda haptic output unit 253.

The display 251 can display graphic objects corresponding to varioustypes of information. The display 251 may include at least one of aLiquid Crystal Display (LCD), a Thin Film Transistor-Liquid CrystalDisplay (TFT LCD), an Organic Light-Emitting Diode (OLED), a flexibledisplay, a 3D display, and an e-ink display.

The display 251 may form an inter-layer structure together with thetouch input unit 213, or may be integrally formed with the touch inputunit 213 to implement a touch screen. The display 251 may also beimplemented as a Head Up Display (HUD). When implemented as a HUD, thedisplay 251 may include a projector module in order to outputinformation through an image projected on a windshield or a window.

The display 251 may include a transparent display. The transparentdisplay may be attached on the windshield or the window. In addition,the transparent display can display a predetermined screen with apredetermined transparency. In order to achieve the transparency, thetransparent display may include at least one of a transparent Thin FilmElectroluminescent (TFEL) display, an Organic Light Emitting Diode(OLED) display, a transparent Liquid Crystal Display (LCD), atransmissive transparent display, and a transparent Light Emitting Diode(LED) display. The transparency of the transparent display may beadjustable.

Further, the user interface apparatus 200 may include a plurality ofdisplays 251 a to 251 g. For example, the display 251 may be disposed ina region of a steering wheel, a region 251 a, 251 b, or 251 e of aninstrument panel, a region 251 d of a seat, a region 251 f of eachpillar, a region 251 g of a door, a region of a center console, a regionof a head lining, a region of a sun visor, a region 251 c of awindshield, or a region 251 h of a window.

The sound output unit 252 converts an electrical signal from theprocessor 270 or the controller 170 into an audio signal, and outputsthe audio signal. Thus, the sound output unit 252 may include one ormore speakers.

The haptic output unit 253 generates a tactile output. For example, thehaptic output unit 253 can operate to vibrate a steering wheel, a safetybelt, and seats 110FL, 110FR, 110RL, and 110RR to allow a user torecognize the output. The processor 270 can also control the overalloperation of each unit of the user interface apparatus 200.

The user interface apparatus 200 may include a plurality of processors270 or may not include the processor 270. When the user interfaceapparatus 200 does not include the processor 270, the user interfaceapparatus 200 can operate under control of the controller 170 or aprocessor of a different device inside the vehicle 100.

Further, the user interface apparatus 200 may be referred to as adisplay device for vehicle. The user interface apparatus 200 can alsooperate under control of the controller 170.

The object detection apparatus 300 can detect an object outside thevehicle 100 and generate information on the object based on sensingdata. The information on the object may include information about thepresence of the object, location information of the object, informationon a distance between the vehicle 100 and the object, and information ona speed of movement of the vehicle 100 relative to the object. Theobject may include various objects related to travelling of the vehicle100.

Referring to FIGS. 5 and 6, an object o includes a lane OB10, a nearbyvehicle OB11, a pedestrian OB12, a two-wheeled vehicle OB13, a trafficsignal OB14 and OB15, a light, a road, a structure, a bump, ageographical feature, an animal, etc. The lane OB10 may be a lane inwhich the vehicle 100 is traveling, a lane next to the lane in which thevehicle 100 is traveling, or a lane in which a different vehicle istravelling in the opposite direction. The lane OB10 may include left andright lines that define the lane. The lane may be a concept including anintersection.

The nearby vehicle OB11 can be a vehicle that is travelling in thevicinity of the vehicle 100. The nearby vehicle OB11 may be a vehiclewithin a predetermined distance from the vehicle 100. For example, thenearby vehicle OB11 may be a vehicle that is preceding or following thevehicle 100.

The pedestrian OB12 may be a person located in the vicinity of thevehicle 100. The pedestrian OB12 may be a person within a predetermineddistance from the vehicle 100. For example, the pedestrian OB12 may be aperson on a sidewalk or on the roadway.

The two-wheeled vehicle OB13 is a vehicle located in the vicinity of thevehicle 100 and moves with two wheels. The two-wheeled vehicle OB13 maybe a vehicle that has two wheels within a predetermined distance fromthe vehicle 100. For example, the two-wheeled vehicle OB13 may be amotorcycle or a bike on a sidewalk or the roadway.

The traffic signal may include a traffic light OB15, a traffic signplate OB14, and a pattern or text painted on a road surface. The lightmay be light generated by a lamp provided in the nearby vehicle. Thelight may be light generated by a street light. The light may be solarlight.

The road may include a road surface, a curve, and slopes, such as anupward slope and a downward slope. The structure may be a body locatedaround the road in the state of being fixed onto the ground. Forexample, the structure may include a streetlight, a roadside tree, abuilding, a traffic light, a bridge, a curb, and a wall.

The geographical feature may include a mountain and a hill. Further, theobject may be classified as a movable object or a stationary object. Forexample, the movable object may be a concept including a moving nearbyvehicle and a moving pedestrian. In addition, the stationary object maybe a concept including a traffic signal, a road, a structure, a stoppednearby vehicle, and a stopped pedestrian.

The object detection apparatus 300 may include a camera 310, a radar320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, anda processor 370. The object detection apparatus 300 may further includeother components in addition to the aforementioned components, or maynot include some of the aforementioned components.

The camera 310 may be located at an appropriate position outside thevehicle 100 in order to acquire images of the outside of the vehicle100. The camera 310 may be a mono camera, a stereo camera 310 a, anAround View Monitoring (AVM) camera 310 b, or a 360-degree camera.

Using various image processing algorithms, the camera 310 can acquirelocation information of an object, information on a distance to theobject, and information on speed relative to the object. For example,based on change in size over time of an object in acquired images, thecamera 310 can acquire information on a distance to the object andinformation on speed relative to the object.

For example, the camera 310 can acquire the information on a distance tothe object and the information on speed relative to the object, by usinga pin hole model or profiling a road surface. Further, the camera 310can acquire the information on a distance to the object and theinformation on the speed relative to the object, based on information ondisparity in stereo images acquired by a stereo camera 310 a.

In addition, the camera 310 may be disposed near a front windshield inthe vehicle 100 in order to acquire images of the front of the vehicle100. Alternatively, the camera 310 may be disposed around a front bumperor a radiator grill. For example, the camera 310 may be disposed near arear glass in the vehicle 100 in order to acquire images of the rear ofthe vehicle 100. Alternatively, the camera 310 may be disposed around arear bumper, a trunk, or a tailgate.

The camera 310 may also be disposed near at least one of the sidewindows in the vehicle 100 in order to acquire images of the side of thevehicle 100. Alternatively, the camera 310 may be disposed around a sidemirror, a fender, or a door. The camera 310 also provides an acquiredimage to the processor 370.

The radar 320 may include an electromagnetic wave transmission unit andan electromagnetic wave reception unit. The radar 320 may also berealized as a pulse radar or a contIMUous wave radar depending on theprinciple of emission of an electronic wave. In addition, the radar 320may be realized as a Frequency Modulated ContIMUous Wave (FMCW) typeradar or a Frequency Shift Keying (FSK) type radar depending on thewaveform of a signal.

The radar 320 can detect an object through the medium of anelectromagnetic wave by employing a time of flight (TOF) scheme or aphase-shift scheme, and can detect a location of the detected object,the distance to the detected object, and the speed relative to thedetected object

The radar 320 may be located at an appropriate position outside thevehicle 100 in order to sense an object located in front of the vehicle100, an object located to the rear of the vehicle 100, or an objectlocated to the side of the vehicle 100.

The lidar 330 may include a laser transmission unit and a laserreception unit. The lidar 330 may be implemented by the TOF scheme orthe phase-shift scheme. The lidar 330 may also be implemented as a drivetype lidar or a non-drive type lidar. When implemented as the drive typelidar, the lidar 300 can rotate by a motor and detect an object in thevicinity of the vehicle 100.

When implemented as the non-drive type lidar, the lidar 300 may utilizea light steering technique to detect an object located within apredetermined distance from the vehicle 100. The vehicle 100 may includea plurality of non-driving type lidars 330.

The lidar 330 can detect an object through the medium of laser light byemploying the TOF scheme or the phase-shift scheme, and can detect alocation of the detected object, the distance to the detected object,and the speed relative to the detected object.

The lidar 330 may be located at an appropriate position outside thevehicle 100 in order to sense an object located in front of the vehicle100, an object located to the rear of the vehicle 100, or an objectlocated to the side of the vehicle 100.

The ultrasonic sensor 340 may include an ultrasonic wave transmissionunit and an ultrasonic wave reception unit. The ultrasonic sensor 340can detect an object based on an ultrasonic wave, and can detect alocation of the detected object, the distance to the detected object,and the speed relative to the detected object.

The ultrasonic sensor 340 may be located at an appropriate positionoutside the vehicle 100 in order to detect an object located in front ofthe vehicle 100, an object located to the rear of the vehicle 100, andan object located to the side of the vehicle 100.

The infrared sensor 350 may include an infrared light transmission unitand an infrared light reception unit. The infrared sensor 340 can detectan object based on infrared light, and can detect a location of thedetected object, the distance to the detected object, and the speedrelative to the detected object.

The infrared sensor 350 may be located at an appropriate positionoutside the vehicle 100 in order to sense an object located in front ofthe vehicle 100, an object located to the rear of the vehicle 100, or anobject located to the side of the vehicle 100.

The processor 370 can control the overall operation of each unit of theobject detection apparatus 300. The processor 370 can detect or classifyan object by comparing pre-stored data with data sensed by the camera310, the radar 320, the lidar 330, the ultrasonic sensor 340, and theinfrared sensor 350.

The processor 370 can detect and track an object based on acquiredimages. The processor 370 may, for example, calculate the distance tothe object and the speed relative to the object. For example, theprocessor 370 can acquire information on the distance to the object andinformation on the speed relative to the object based on a variation insize over time of the object in acquired images.

For example, the processor 370 can acquire information on the distanceto the object or information on the speed relative to the object byusing a pin hole model or by profiling a road surface. For example, theprocessor 370 can acquire information on the distance to the object andinformation on the speed relative to the object based on information ondisparity in stereo images acquired from the stereo camera 310 a.

The processor 370 can detect and track an object based on a reflectionelectromagnetic wave which is formed as a result of reflection atransmission electromagnetic wave by the object. Based on theelectromagnetic wave, the processor 370 can, for example, calculate thedistance to the object and the speed relative to the object.

The processor 370 can detect and track an object based on a reflectionlaser light which is formed as a result of reflection of transmissionlaser by the object. Based on the laser light, the processor 370 can,for example, calculate the distance to the object and the speed relativeto the object.

In addition, the processor 370 can detect and track an object based on areflection ultrasonic wave which is formed as a result of reflection ofa transmission ultrasonic wave by the object. Based on the ultrasonicwave, the processor 370 can, for example, calculate the distance to theobject and the speed relative to the object.

The processor 370 can detect and track an object based on reflectioninfrared light which is formed as a result of reflection of transmissioninfrared light by the object. Based on the infrared light, the processor370 can, for example, calculate the distance to the object and the speedrelative to the object.

The object detection apparatus 300 may include a plurality of processors370 or may not include the processor 370. For example, each of thecamera 310, the radar 320, the lidar 330, the ultrasonic sensor 340, andthe infrared sensor 350 may include its own processor.

When the object detection apparatus 300 does not include the processor370, the object detection apparatus 300 can operate under control of thecontroller 170 or a processor inside the vehicle 100. The objectdetection apparatus 300 can operate under control of the controller 170.

The communication apparatus 400 is configured to perform communicationwith an external device. Here, the external device may be a nearbyvehicle, a mobile terminal, or a server. To perform communication, thecommunication apparatus 400 may include at least one of a transmissionantenna, a reception antenna, a Radio Frequency (RF) circuit capable ofimplementing various communication protocols, and an RF device.

The communication apparatus 400 may include a short-range communicationunit 410, a location information unit 420, a V2X communication unit 430,an optical communication unit 440, a broadcast transmission andreception unit 450, an Intelligent Transport Systems (ITS) communicationunit 460, and a processor 470.

The communication apparatus 400 may further include other components inaddition to the aforementioned components, or may not include some ofthe aforementioned components.

The short-range communication unit 410 is configured to performshort-range communication. The short-range communication unit 410 maysupport short-range communication using at least one of Bluetooth™,Radio Frequency IDdentification (RFID), Infrared Data Association(IrDA), Ultra-WideBand (UWB), ZigBee, Near Field Communication (NFC),Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless USB (WirelessUniversal Serial Bus). The short-range communication unit 410 may formwireless area networks to perform short-range communication between thevehicle 100 and at least one external device.

The location information unit 420 can acquire location information ofthe vehicle 100. For example, the location information unit 420 mayinclude a Global Positioning System (GPS) module or a DifferentialGlobal Positioning System (DGPS) module.

The V2X communication unit 430 can perform wireless communicationbetween a vehicle and a server (that is, vehicle to infra (V2I)communication), wireless communication between a vehicle and a nearbyvehicle (that is, vehicle to vehicle (V2V) communication), or wirelesscommunication between a vehicle and a pedestrian (that is, vehicle topedestrian (V2P) communication).

The optical communication unit 440 can perform communication with anexternal device through the medium of light. The optical communicationunit 440 may include a light emitting unit, which converts an electricalsignal into an optical signal and transmits the optical signal to theoutside, and a light receiving unit which converts a received opticalsignal into an electrical signal. The light emitting unit may beintegrally formed with a lamp provided included in the vehicle 100.

The broadcast transmission and reception unit 450 can receive abroadcast signal from an external broadcasting management server ortransmit a broadcast signal to the broadcasting management serverthrough a broadcasting channel. The broadcasting channel may include asatellite channel, and a terrestrial channel. The broadcast signal mayinclude a TV broadcast signal, a radio broadcast signal, and a databroadcast signal.

The ITS communication unit 460 can exchange information, data, orsignals with a traffic system. The ITS communication unit 460 mayprovide acquired information or data to the traffic system. The ITScommunication unit 460 can receive information, data, or signals fromthe traffic system. For example, the ITS communication unit 460 canreceive traffic volume information from the traffic system and providethe traffic volume information to the controller 170. In anotherexample, the ITS communication unit 460 can receive a control signalfrom the traffic system, and provide the control signal to thecontroller 170 or a processor provided in the vehicle 100.

The processor 470 can control the overall operation of each unit of thecommunication apparatus 400. The communication apparatus 400 may includea plurality of processors 470, or may not include the processor 470.When the communication apparatus 400 does not include the processor 470,the communication apparatus 400 can operate under control of thecontroller 170 or a processor of a device inside of the vehicle 100.

Further, the communication apparatus 400 may implement a vehicle displaydevice, together with the user interface apparatus 200. In thisinstance, the vehicle display device may be referred to as a telematicsdevice or an Audio Video Navigation (AVN) device. The communicationapparatus 400 can operate under control of the controller 170.

The driving manipulation apparatus 500 can receive a user input fordriving the vehicle 100. In the manual mode, the vehicle 100 can operatebased on a signal provided by the driving manipulation apparatus 500.The driving manipulation apparatus 500 may include a steering inputdevice 510, an acceleration input device 530, and a brake input device570. The steering input device 510 can receive a user input with regardto the direction of travel of the vehicle 100. The steering input device510 may take the form of a wheel to enable a steering input through therotation thereof. The steering input device may be provided as atouchscreen, a touch pad, or a button.

The acceleration input device 530 can receive a user input foracceleration of the vehicle 100. The brake input device 570 can receivea user input for deceleration of the vehicle 100. Each of theacceleration input device 530 and the brake input device 570 may takethe form of a pedal. The acceleration input device or the break inputdevice may also be configured as a touch screen, a touch pad, or abutton.

The driving manipulation apparatus 500 can operate under control of thecontroller 170. The vehicle drive apparatus 600 is configured toelectrically control the operation of various devices of the vehicle100.

In addition, the vehicle drive apparatus 600 may include a power traindrive unit 610, a chassis drive unit 620, a door/window drive unit 630,a safety apparatus drive unit 640, a lamp drive unit 650, and an airconditioner drive unit 660. The vehicle drive apparatus 600 may furtherinclude other components in addition to the aforementioned components,or may not include some of the aforementioned components.

Further, the vehicle drive apparatus 600 may include a processor. Eachunit of the vehicle drive apparatus 600 may also include its ownprocessor. The power train drive unit 610 can control the operation of apower train. The power train drive unit 610 may include a power sourcedrive unit 611 and a transmission drive unit 612.

The power source drive unit 611 can control a power source of thevehicle 100. When a fossil fuel-based engine is the power source, thepower source drive unit 611 can perform electronic control of theengine. As such the power source drive unit 611 can control, forexample, the output torque of the engine. The power source drive unit611 can adjust the output toque of the engine under control of thecontroller 170.

When an electric motor is the power source, the power source drive unit611 can control the motor. The power source drive unit 611 can control,for example, the RPM and toque of the motor under control of thecontroller 170.

The transmission drive unit 612 can control a transmission. Thetransmission drive unit 612 can adjust the state of the transmission.The transmission drive unit 612 can also adjust a state of thetransmission to a drive (D), reverse (R), neutral (N), or park (P)state.

Further, when an engine is the power source, the transmission drive unit612 can adjust a gear-engaged state to the drive position D. The chassisdrive unit 620 can control the operation of a chassis. The chassis driveunit 620 may include a steering drive unit 621, a brake drive unit 622,and a suspension drive unit 623.

The steering drive unit 621 can perform electronic control of a steeringapparatus provided inside the vehicle 100. The steering drive unit 621can change the direction of travel of the vehicle 100. The brake driveunit 622 can perform electronic control of a brake apparatus providedinside the vehicle 100. For example, the brake drive unit 622 can reducethe speed of the vehicle 100 by controlling the operation of a brakelocated at a wheel.

Further, the brake drive unit 622 can control a plurality of brakesindividually. The brake drive unit 622 may apply a differentdegree-braking force to each wheel. The suspension drive unit 623 canperform electronic control of a suspension apparatus inside the vehicle100. For example, when the road surface is uneven, the suspension driveunit 623 can control the suspension apparatus to reduce the vibration ofthe vehicle 100.

Further, the suspension drive unit 623 can control a plurality ofsuspensions individually. The door/window drive unit 630 can performelectronic control of a door apparatus or a window apparatus inside thevehicle 100.

The door/window drive unit 630 may include a door drive unit 631 and awindow drive unit 632. The door drive unit 631 can control the doorapparatus and can also control opening or closing of a plurality ofdoors included in the vehicle 100. The door drive unit 631 can controlan opening or closing of a trunk or a tail gate and control opening orclosing of a sunroof.

The window drive unit 632 can perform electronic control of the windowapparatus. The window drive unit 632 can control opening or closing of aplurality of windows included in the vehicle 100. The safety apparatusdrive unit 640 can perform electronic control of various safetyapparatuses provided inside the vehicle 100.

The safety apparatus drive unit 640 may include an airbag drive unit641, a safety belt drive unit 642, and a pedestrian protection equipmentdrive unit 643. The airbag drive unit 641 can perform electronic controlof an airbag apparatus inside the vehicle 100. For example, upondetection of a dangerous situation, the airbag drive unit 641 cancontrol an airbag to be deployed.

The safety belt drive unit 642 can perform electronic control of aseatbelt apparatus inside the vehicle 100. For example, upon detectionof a dangerous situation, the safety belt drive unit 642 can controlpassengers to be fixed onto seats 110FL, 110FR, 110RL, and 110RR withsafety belts.

The pedestrian protection equipment drive unit 643 can performelectronic control of a hood lift and a pedestrian airbag. For example,upon detection of a collision with a pedestrian, the pedestrianprotection equipment drive unit 643 can control a hood lift and apedestrian airbag to be deployed. The lamp drive unit 650 can performelectronic control of various lamp apparatuses provided inside thevehicle 100.

The air conditioner drive unit 660 can perform electronic control of anair conditioner inside the vehicle 100. For example, when the innertemperature of the vehicle 100 is high, an air conditioner drive unit660 can operate the air conditioner to supply cool air to the inside ofthe vehicle 100.

The vehicle drive apparatus 600 may include a processor. Each unit ofthe vehicle dive device 600 may include its own processor. The vehicledrive apparatus 600 can operate under control of the controller 170.

The vehicle travel system 700 is a system for controlling the overalldriving operation of the vehicle 100. The vehicle travel system 700 canoperate in the autonomous driving mode and may include the drivingsystem 710, the parking-out system 740, and the parking system 750. Thevehicle travel system 700 may further include other components inaddition to the aforementioned components, or may not include some ofthe aforementioned component.

Further, the vehicle travel system 700 may include a processor and eachunit of the vehicle travel system 700 may include its own processor.When the vehicle travel system 700 is implemented as software, thevehicle travel system 700 may be a subordinate concept of the controller170.

Further, the vehicle travel system 700 may be a concept including atleast one of the user interface apparatus 200, the object detectionapparatus 300, the communication apparatus 400, the driving manipulationapparatus 500, the vehicle drive apparatus 600, the navigation system770, the sensing unit 120, and the controller 170.

In addition, the driving system 710 can perform driving of the vehicle100 by providing a control signal to the vehicle drive apparatus 600based on navigation information from the navigation system 770. Thedriving system 710 can also perform driving of the vehicle 100 byproviding a control signal to the vehicle drive apparatus 600 based oninformation on an object received from the object detection apparatus300. Further, the driving system 710 can perform driving of the vehicle100 by providing a control signal to the vehicle drive apparatus 600based on a signal from an external device through the communicationapparatus 400.

The driving system 710 includes at least one of the user interfaceapparatus 200, the object detection apparatus 300, the communicationapparatus 400, the driving manipulation apparatus 500, the vehicledriving device 600, the navigation system 770, the sensing unit 120, andthe controller 170, and which performs driving of the vehicle 100. Thedriving system 710 may also be referred to as a vehicle driving controlapparatus.

The parking-out system 740 can perform an operation of pulling thevehicle 100 out of a parking space. For example, the parking-out system740 can perform an operation of pulling the vehicle 100 out of a parkingspace, by providing a control signal to the vehicle drive apparatus 600based on navigation information from the navigation system 770.

The parking-out system 740 can also perform an operation of pulling thevehicle 100 out of a parking space, by providing a control signal to thevehicle drive apparatus 600 based on information on an object receivedfrom the object detection apparatus 300. Further, the parking-out system740 can perform an operation of pulling the vehicle 100 out of a parkingspace, by providing a control signal to the vehicle drive apparatus 600based on a signal received from an external device.

The parking-out system 740 includes at least one of the user interfaceapparatus 200, the object detection apparatus 300, the communicationapparatus 400, the driving manipulation apparatus 500, the vehicledriving device 600, the navigation system 770, the sensing unit 120, andthe controller 170, and which performs an operation of pulling thevehicle 100 out of a parking space. The parking-out system 740 may bereferred to as a vehicle parking-out control apparatus and can performan operation of parking the vehicle 100 in a parking space.

The parking system 750 can also perform an operation of parking thevehicle 100 in a parking space, by providing a control signal to thevehicle drive apparatus 600 based on navigation information from thenavigation system 770. The parking system 750 can perform an operationof parking the vehicle 100 in a parking space, by providing a controlsignal to the vehicle drive apparatus 600 based on information on anobject received from the object detection apparatus 300.

Further, the parking system 750 can perform an operation of parking thevehicle 100 in a parking space, by providing a control signal to thevehicle drive apparatus 600 based on a signal from an external device.The parking system 750 may be a system which includes at least one ofthe user interface apparatus 200, the object detection apparatus 300,the communication apparatus 400, the driving manipulation apparatus 500,the vehicle driving device 600, the navigation system 770, the sensingunit 120, and the controller 170, and which performs an operation ofparking the vehicle 100. The parking system 750 may be referred to as avehicle parking control apparatus.

In addition, the navigation system 770 provides navigation informationsuch as map information, information on a set destination, informationon a route to the set destination, information on various objects alongthe route, lane information, and information on a current location ofthe vehicle.

The navigation system 770 may also include a memory and a processor. Thememory may store navigation information. In addition, the processor cancontrol the operation of the navigation system 770 and may updatepre-stored information by receiving information from an external devicethrough the communication apparatus 400. The navigation system 770 maybe classified as an element of the user interface apparatus 200.

In addition, the sensing unit 120 can sense the state of the vehicle andmay include an Inertial Measurement Unit (IMU) sensor, a collisionsensor, a wheel sensor, a speed sensor, a gradient sensor, a weightsensor, a heading sensor, a position module, a vehicle forward/reversemovement sensor, a battery sensor, a fuel sensor, a tire sensor, asteering sensor based on the rotation of the steering wheel, anin-vehicle temperature sensor, an in-vehicle humidity sensor, anultrasonic sensor, an illumination sensor, an accelerator pedal positionsensor, and a brake pedal position sensor.

Further, the IMU sensor may include at least one of an accelerometer, agyro sensor, and a magnetic sensor. The sensing unit 120 can acquiresensing signals with regard to, for example, vehicle attitudeinformation, vehicle motion information, vehicle yaw information,vehicle roll information, vehicle pitch information, vehicle collisioninformation, vehicle driving direction information, vehicle locationinformation (GPS information), vehicle angle information, vehicle speedinformation, vehicle acceleration information, vehicle tilt information,vehicle forward/reverse movement information, battery information, fuelinformation, tire information, vehicle lamp information, in-vehicletemperature information, in-vehicle humidity information, steering-wheelrotation angle information, out-of-vehicle illumination information,information about the pressure applied to an accelerator pedal, andinformation about the pressure applied to a brake pedal.

The sensing unit 120 may further include, for example, an acceleratorpedal sensor, a pressure sensor, an engine speed sensor, an AirFlow-rate Sensor (AFS), an Air Temperature Sensor (ATS), a WaterTemperature Sensor (WTS), a Throttle Position Sensor (TPS), a Top DeadCenter (TDC) sensor, and a Crank Angle Sensor (CAS).

The sensing unit 120 can generate vehicle state information based onsensing data. The vehicle state information may be information that isgenerated based on data sensed by various sensors provided inside thevehicle 100. For example, the vehicle state information may includevehicle position information, vehicle speed information, vehicle tiltinformation, vehicle weight information, vehicle direction information,vehicle battery information, vehicle fuel information, vehicle tirepressure information, vehicle steering information, in-vehicletemperature information, in-vehicle humidity information, pedal positioninformation, vehicle engine temperature information, etc.

The interface 130 serves as a passage for various kinds of externaldevices that are connected to the vehicle 100. For example, theinterface 130 may have a port that is connectable to a mobile terminaland may be connected to the mobile terminal via the port. In thisinstance, the interface 130 can exchange data with the mobile terminal.

Further, the interface 130 serves as a passage for the supply ofelectrical energy to a mobile terminal connected thereto. When themobile terminal is electrically connected to the interface 130, theinterface 130 may provide electrical energy, supplied from the powersupply unit 190, to the mobile terminal under control of the controller170.

The memory 140 is electrically connected to the controller 170 and canstore basic data for each unit, control data for the operational controlof each unit, and input/output data. The memory 140 may be any ofvarious hardware storage devices, such as a ROM, a RAM, an EPROM, aflash drive, and a hard drive. The memory 140 may store various data forthe overall operation of the vehicle 100, such as programs for theprocessing or control of the controller 170.

In addition, the memory 140 may be integrally formed with the controller170, or may be provided as an element of the controller 170. Thecontroller 170 can control the overall operation of each unit inside thevehicle 100 and may be referred to as an Electronic Controller (ECU).

The power supply unit 190 can supply power required to operate eachcomponent under control of the controller 170. In particular, the powersupply unit 190 can receive power from, for example, a battery insidethe vehicle 100.

At least one processor and the controller 170 included in the vehicle100 may be implemented using at least one of Application SpecificIntegrated Circuits (ASICs), Digital Signal Processors (DSPs), DigitalSignal Processing Devices (DSPDs), Programmable Logic Devices (PLDs),Field Programmable Gate Arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, and electric units for theimplementation of other functions.

Next, FIG. 8 is a block diagram illustrating a user interface apparatusfor a vehicle according for vehicle to an embodiment of the presentinvention. Referring to FIG. 8, a user interface apparatus 200 for avehicle may include an AR camera 225, a memory 240, an interface unit245, an output device 250, a processor 270, and a power supply unit 290.

The user interface apparatus 200 may further include an input device210, an internal camera 220 and a biometric sensing unit 230individually or in combination. Relevant description provided above withreference to FIG. 7 may also be applied to the input device 210.

The input device 210 can receive a user input through at least one ofthe voice input unit 211, the gesture input unit 212, a touch input unit213, and a mechanical input unit 214. The input device 210 can receive auser input for changing a crop area of a forward view image of thevehicle 100.

The input device 210 can receive a first user input. The first userinput may be a user input for stopping changing of a crop area. Theinput device 210 can receive a second user input. For example, thesecond user input may be a user input for changing a size of a croparea. Relevant description provided above with reference to FIG. 7 maybe applied to the internal camera 220.

The AR camera 225 can capture a forward view image of the vehicle 100and may be disposed inside the vehicle 100 while being directed forward.It is preferable the AR camera 225 is disposed close to a windshield.

An image captured by the AR camera 225 may be provided to the processor270. The description provided with reference to FIG. 7 can be applied tothe input device 210 and the biometric sensing unit 230.

The memory 240 is electrically connected to the processor 270 and canstore basic data of each unit, control data for controlling theoperation of each unit, and input/output data. The memory 240 may be anyof various hardware storage devices, such as a ROM, a RAM, an EPROM, aflash drive, and a hard drive. The memory 240 may store various data forthe overall operation of the user interface 200, such as programs forthe processing or control of the processor 270.

In addition, the memory 240 may be integrated with the processor 270, ormay be an element of the processor 270. The interface unit 245 canexchange information, data, or a signal with a different device includedin the vehicle 100. Further, the interface unit 245 can transmit thereceived information, data, or signal to the processor 270. Theinterface unit 245 can transmit information, data, or a signal generatedor processed by the processor 270 to a different device included in thevehicle 100. The interface unit 245 can receive information, data, or asignal from a different device included in the vehicle 100.

The interface unit 245 can receive information about an object locatedahead of the vehicle 100 from the object detection apparatus 300. Theinterface unit 245 can receive driving situation information. Theinterface unit 245 can also receive information on an object locatedoutside the vehicle 100 from the object detection apparatus 300. Forexample, the interface unit 245 can receive information on an objectlocated ahead of vehicle 100.

In addition, the interface unit 245 can receive navigation informationfrom the navigation system 770. The interface unit 245 can receivevehicle state information from the sensing unit 120. For example, theinterface unit 245 can receive steering angle information from thesensor unit 120. The steering angle information may include informationabout a degree of change of a steering angle, and information about aspeed of change of a steering angle.

Further, the interface unit 245 can receive heading angle informationfrom the sensor unit 120. The heading angle information may includeinformation about a degree of change of a heading angle, and informationabout a speed of change of heading angle. For example, the interfaceunit 245 can receive information on a motion of the vehicle 100 from thesensing unit 120.

The interface unit 245 can also receive yaw angle information of thevehicle 100 from the sensing unit 120. The yaw angle information mayinclude information about a degree of change of a yaw angle, andinformation about a speed of change of a yaw angle. The interface unit245 can also receive pitch angle information of the vehicle 100 from thesensing unit 120. The pitch angle information may include informationabout a degree of change of a pitch angle, and information about a speedof change of a pitch angle.

In addition, the interface unit 245 can receive curve information fromthe object detection apparatus 300 or the navigation system 770. Forexample, the interface unit 245 can receive information about a curvelocated within a specific resistance ahead of the vehicle 100. Theinterface unit 245 can also receive bump information from the objectdetection apparatus 300 or the navigation system 770. For example, theinterface unit 245 can receive information about a bump located within aspecific distance ahead of the vehicle 100.

Information, data, or a signal received by the interface unit 245 may beprovided to the processor 270. The output device 250 can outputinformation, processed by the processor 270, as at least one of a visualoutput, an audible output, and a tactile output. The output unit 250 mayinclude a display 251.

Based on the control of the processor 270, the display 251 can output animage of a crop area in a forward view image of the vehicle 100. Basedon the control of the processor 270, the display 251 can overlay an ARgraphic object, corresponding to the crop area, on the image of the croparea. The display 251 can output an image of a changed crop area basedon the control of the processor 270.

Based on the control of the processor 270, the display 251 can overlay achanged AR graphic object on the image of the changed crop area.Further, the display 251 may be elongated in the overall width directionin the lower side of a windshield. Alternatively, the display 251 may beelongated in the overall width direction in the upper side of adashboard.

The display 251 can output various types of contents other than an imageof a crop area, based on the control of the processor 270. For example,the display 251 can display vehicle control-relevant contents, contentsfor providing various types of information, contents associated with amobile terminal, etc.

The output unit 250 may further include a sound output unit 252 and ahaptic output unit 253 individually or in combination thereof. Theprocessor 270 may be electrically connected to each unit of the userinterface apparatus 200. In addition, the processor 270 can control theoverall operation of each unit of the user interface apparatus 200. Theprocessor 270 can receive a forward view image of the vehicle 100 fromthe AR camera 225. The forward view image acquired by the AR camera 225may be used as an image on which an AR graphic object is overlaid.

In some embodiments, through the interface unit 245, the processor 270can receive a forward view image of the vehicle 100 from the camera 310included in the object detection apparatus 300. In this instance, theforward view image acquired by the camera 310 may be used as an image onwhich an AR graphic object is overlaid.

The processor 270 can receive information about an object located infront of the vehicle 100 from the object detection apparatus 200 throughthe interface unit 245. The processor 270 can also crop one part of theforward view image of the vehicle 100. In particular, the processor 270can crop a part of the forward view image in a form suitable to beoutput through the display unit 251. The camera 310 also has aparticular field of view (FOV), and acquire a forward view imagedepending on the FOV.

The processor 270 can also crop only a necessary part of an acquiredforward view image, and output an image of the crop area through thedisplay unit 251. The processor 270 can match object information and theforward view image of the vehicle 100. Specifically, the processor 270can match an object present in a crop area of the forward view imagewith object information which is received through the interface unit245. Further, the processor 270 can control the display 251 to overlayan AR graphic object, corresponding to the crop area, on an image of thecrop area.

The processor 270 can also generate an AR graphic object correspondingto an object located in an image of a crop area. The AR graphic objectmay correspond to an object detected from the image of the crop area.Further, the AR graphic object may include at least one of a carpetimage indicative of a moving direction, a turn-by-turn (TBT) image, anobject highlight image, a wall image, and a Point of Interest (POI)image.

In addition, the processor 270 can overlay the generated AR graphicobject on the image of the crop area and control the display 251 todisplay an image on which the AR graphic object is overlaid on the imageof the crop area. The processor 270 can also receive driving situationinformation through the interface unit 245 and change a crop area basedon the driving situation information received through the interface unit245.

By changing the crop area, it is possible to provide a user with animage which is appropriate for a driving situation. Based on the drivingsituation information, the processor 270 can control the display 251 tochange an AR graphic object. By changing the AR graphic object, it ispossible to provide an AR graphic object which is appropriate for adriving situation, thereby providing a user with accurate information.

Further, driving situation information may include at least one ofinformation about an object located outside the vehicle 100, navigationinformation, and vehicle state information. For example, the drivingsituation information may include at least one of steering angleinformation, heading angle information, yaw angle information, pitchangle information, curve information, and bump information.

The processor 270 can also set a center point in the crop area andchange a center point in a front view image based on the drivingsituation information. In addition, the processor 270 can change thecrop area in response to the changing of the center point of the croparea. The processor 270 can also receive steering angle informationthrough the interface unit 245. The steering angle information mayinclude information about a degree of change of a steering angle, andinformation about a speed of change of the steering angle.

Further, the processor 270 can change a crop area on a front view imageby moving the crop area leftward or rightward on the front view imagebased on the steering angle information. The processor 270 can alsodetermine a degree of movement of the crop area based on the informationabout a degree of change of a steering angle. For example, the processor270 can move the crop area in proportion to the degree of change of thesteering angle.

The processor 270 can determine a speed of movement of the crop areabased on the information on a speed of change of a steering angle. Forexample, the processor 270 can move the crop area at a speed inproportion to the speed of change of the steering angle. The processor270 can receive heading angle information through the interface unit245. The heading angle information may include information about adegree of change of a heading angle, and information about a sped ofchange in the heading angle. Based on the heading angle information, theprocessor 270 can change a crop area on a forward view image by movingthe crop area leftward and rightward on the forward view image.

The processor 270 can also determine a degree of movement of the croparea based on the information about the degree of change of the headingangle. For example, the processor 270 can move the crop area inproportion to the degree of change of the heading angle.

In addition, the processor 270 can determine a speed of movement of thecrop area based on the information about the speed of change of theheading angle. For example, the processor 270 can move the crop area ata speed in proportion to the speed of change of the heading angle. Theprocessor 270 can receive yaw angle information through the interfaceunit 245. The yaw angle information may include information about adegree of change of a yaw angle, and information about a speed of changeof the yaw angle. The processor 270 can change a crop area on a forwardview image by moving the crop area leftward or rightward on the forwardview image based on yaw angle information.

The processor 270 can determine a degree of movement of the crop areabased on the information about a degree in change of a yaw angle. Forexample, the processor 270 can move the crop area in proportion to thedegree of change of the yaw angle.

The processor 270 can determine a speed of movement of the crop areabased on the information about a speed of change of a yaw angle. Forexample, the processor 270 can move the crop area at a speed inproportion to the speed of change of the yaw angle. The processor 270can receive pitch angle information through the interface unit 245. Thepitch angle information may include information about a degree of changeof a pitch angle, and information about a speed of change of the pitchangle. The processor 270 can change a crop area on a front view image bymoving the crop area upward or downward on the forward view image basedon the pitch angle information.

The processor 270 can determine a degree of movement of the crop areabased on the information about a degree of change of a pitch angle. Forexample, the processor 270 can move the crop area in proportion to thedegree of change of the pitch angle. Based on the information about aspeed of movement of the pitch angle, the processor 270 can determine aspeed of change of the crop area. For example, the processor 270 canmove the crop area at a speed in proportion to the speed of change ofthe pitch angle.

The processor 270 can receive a user input trough the input device 210.The processor 270 can control a crop operation based on the user input.For example, based on a first user input, the processor 270 may stopchanging a crop area. For example, based on a second user input, theprocessor 270 can change the size of a crop area, and based on a thirduser input, the processor 270 can change a position of the crop area.The processor 270 can control the display 251 to overlay a carpet imageor a TBT image indicative of a moving direction on a lane present in thecrop area.

The processor 270 can control the display 251 to change a position ofthe carpet image or the TBT image in response to a change of the croparea. If the lane disappears from the displayed image as the crop areais changed, the processor 270 can control the display 251 to make thecarpet image or the TBT image disappear. The processor 270 can alsocontrol the display 251 to overlay a highlight image on a moving objectpresent in the crop area and control the display 251 to change aposition of the highlight image in response to a change of the croparea.

If the moving object disappears from the displayed image as the croparea is changed, the processor 270 can control the display 251 to makethe highlight image disappear. The processor 270 can also control thedisplay 251 based on driving situation information to change a size or acolor of the highlight image.

Further, the processor 270 can control the display 251 to overlay a wallimage on a line present in a crop area and control the display 251 tochange a position of the wall image in response to changing of the croparea. The processor 270 can also receive steering angle informationthrough the interface unit 245 and control the display 251 based on thesteering angle information to display an AR graphic object whichcorresponds to an object present on a scheduled travel path of thevehicle 100.

With an AR graphic object being displayed, the processor 270 can changea crop area on a forward view image by moving the crop area leftward orrightward on the forward view image based on the steering angleinformation. The processor 270 can control the display 251 to overlay anAR graphic object, corresponding to an object, on the changed crop area.

Further, the processor 270 can expand a crop area based on drivingsituation information. When steering angle information is receivedthrough the interface unit 245 with a first content being displayed in afirst zone of the display 251, the processor 270 can control the display251 to an image of the expanded crop area in at least part of the firstzone.

The processor 270 can also determine a degree of expansion of the croparea in proportion to a size of a steering angle. The processor 270 canreceive speed information through the interface unit 245 and expand orreduce a crop area based on the speed information. When a speed of thevehicle increases, the processor 270 can gradually expand the crop areaand when the speed of the vehicle decreases, the processor 270 cangradually reduce the crop area.

Further, the processor 270 can receive information about a curve aheadof the vehicle 100 through the interface unit 245 and change a crop areaby moving a crop area leftward or rightward based on the informationabout the curve. The processor 270 also control the display 251 based onthe information about the curve to change an AR graphic object. Theprocessor 270 can receive information about a bump ahead of the vehicle100 through the interface unit 245. The processor 270 can change a croparea by moving the crop area upward or downward based on the informationabout the bump.

In addition, the processor 270 can control the display unit 251 based onthe information about the bump to change an AR graphic object. Theprocessor 270 can receive a rear view image through the interface unit245 and crop a part of the rear view image. The processor 270 cancontrol the display 251 to overlay an AR graphic object, correspondingto a crop area of the rear view image, on an image of the crop area.

Further, processor 270 can receive steering angle information throughthe interface unit 245. Based on the steering angle information, theprocessor 270 can control the display 251 to change the AR graphicobject corresponding to the crop area of the rear view image. Under thecontrol of the processor 270, the power supply unit 290 can supply powerrequired for operation of each unit of the user interface apparatus 200.In particular, the power supply unit 290 can receive power from abattery provided inside a vehicle.

Next, FIG. 9 is a flowchart illustrating a user interface apparatus forvehicle according to an embodiment of the present invention. Referringto FIG. 9, the processor 270 receives a forward view image from the ARcamera 225 in S910. For example, the processor 270 can receive a forwardview image from the camera 310 of the object detection apparatus 300through the interface unit 245. In this instance, the forward view imageacquired by the camera 310 which detects an object can be used as animage on which the AR graphic object is overlaid.

In addition, the processor 270 crops one part of the forward view imagein S920 and generates an AR object which corresponds to an objectdetected from an image of the crop area in S930. The processor 270 thendisplays the AR graphic object on the display 251 in a manner such thatthe AR graphic object is overlaid on the image of the crop area in S940.For example, the processor 270 can display a carpet image or a TBT imageindicative of a moving direction on the display 251 in a manner suchthat the corresponding image is overlaid on a lane of travel present inthe image of the crop area.

For example, the processor 270 can display a highlight image on thedisplay 251 in a manner such that the highlight image is overlaid on amoving object present in the image of the crop area. The processor 270can also display a wall image on the display 251 in a manner such thatthe wall image is overlaid on a line present in the image of the croparea. Further, the processor 270 can determine whether driving situationinformation is received through the interface unit 245 in S950. Whendriving situation information is received (Yes in S950), the processor270 changes the crop area based on the driving situation information inS960.

When driving situation information is received, the processor 270changes an AR graphic object based on the driving situation informationin S970. The processor 270 then displays the changed AR graphic objecton the display 251 in a manner such that the changed AR graphic objectis overlaid on the changed crop area in S980.

FIG. 10 is a diagram illustrating a crop operation according to anembodiment of the present invention. Referring to FIG. 10, the AR camera225 can capture a forward view image 1010. The forward view image may bea video or a still image. The processor 170 can receive the forward viewimage 1010 and crop one part of the forward view image 1010. Theprocessor 270 then controls the display unit 251 to display an image ofa crop area 1020.

Cropping can be defined as an operation of cutting off a necessary imagefrom an entire image captured with a field of view (FOV) of the camera310. For example, the processor 270 can crop a part 1020 necessary for auser from the forward view image 1010 and display the crop area 1020.The processor 270 can crop a part 1020 necessary to control travellingof the vehicle 100 from the forward view image 1010, and display thecrop area 1020. The processor 270 can also generate an AR graphic object1035 which corresponding to an object 1030 detected from an image of thecrop area 1020.

The processor 270 can control the display 251 to overlay the AR graphicobject 1035, corresponding to the object 1030 detected from the image ofthe crop area 1020, on the image of the crop area 1020. Further, theprocessor 270 can receive driving situation information through theinterface unit 245 and change the crop area 1020 based on the drivingsituation information.

The processor 270 can also set a center point 1050 of the crop area 1020and change the center point 1050 based on the driving situationinformation. The processor 270 can change the crop area 1020 based onthe change of the center point 1050. For example, while moving thecenter point 1050, the processor 270 can move the crop area 1020 as muchas a variation of movement of the center point 1050. While moving thecenter point 1050, the processor 270 can move the crop area 1020 at thesame speed at which the center point 1050 is being moved. The processor270 can control the display 251 based on the driving situationinformation to change the AR graphic object 1030.

Next, FIGS. 11A and 11B are diagrams illustrating an operation of a userinterface apparatus according to an embodiment of the present invention.Through the interface unit 245, the processor 270 can receive at leastone of steering angle information, yaw angle information, heading angleinformation, and curve information.

In addition, the processor 270 can change a crop area based on at leastone of the steering angle information, the yaw angle information, theheading angle information, and the curve information. The processor 270can also control the display 251 based on at least one of the steeringangle information, the yaw angle information, the heading angleinformation, and the curve information to change an AR graphic object.

Referring to FIG. 11A, the camera 310 can capture a forward view imagewith a predetermined FOV. Reference numeral 1101 indicates a partialregion of an image that can be captured in a horizontal direction withthe FOV of the camera 310. Reference numeral 1102 indicates abefore-change crop region with reference to the horizontal direction.The processor 270 can crop a part of the forward view image, and controlthe display 251 to output an image 1131 corresponding the cropped part.The processor 270 can also generate an AR graphic object 1112 whichcorresponds to a traffic line 1111 detected from the image 1131 of thecrop area.

Further, the processor 270 can overlay the AR graphic object 1112 on theimage 1131 corresponding to the crop area. Another vehicle 1100 may alsobe travelling ahead of the vehicle 100. When another vehicle 1100 istravelling a curve before the vehicle 100 is yet to enter the curve, ifa driving situation is not reflected, the user interface apparatus 200is not able to provide a user with information about the other vehicle1100.

Referring to FIG. 11B, the processor 270 can change a cropped region. Inparticular, reference numeral 1103 indicates a changed crop area. Inaddition, the processor 270 can receive information about a left curvefrom the navigation system 770 or the object detection apparatus 300through the interface unit 245. If a leftward steering input is receivedin response to the curve, the processor 270 can receive informationabout a leftward steering angle through the interface unit 245. If a yawangle is changed leftward in response to the leftward steering input,the processor 270 can receive yaw angle information indicating theleftward change of the yaw angle through the interface unit 245.

If a heading angle is changed leftward in response to the leftwardsteering input, the processor 270 can receive heading angle informationindicating the leftward change of the heading angle through theinterface unit 245. Based on at least one of information about thecurve, the steering angle information, the heading angle information,and the yaw angle information, the processor 270 can change a crop areaon a forward view image by moving the crop area leftward on the forwardview image.

The processor 270 can also control the display 251 to display an image1132 corresponding to the changed crop area. Based on at least one ofinformation about the curve, the steering angle information, the headingangle information, and the yaw angle information, the processor 270 cancontrol the display 251 to move the AR graphic 1112 rightward on adisplayed image.

Based on at least one of information about the curve, the steering angleinformation, the heading angle information, and the yaw angleinformation, the processor 270 can control the display 251 to display anew graphic object 1122. The graphic object 1122 may correspond to a newobject 1122 present in the image 1132 which is displayed on the display251 due to the change of the crop area.

Next, FIGS. 12A and 12B are diagrams illustrating an operation of a userinterface apparatus according to an embodiment of the present invention.The processor 270 can receive at least one of pitch angle informationand information about a bump 1260 through the interface unit 245 andchange a cropping region based on at least one of the pitch angleinformation and the information about the bump 1260. Based on at leastone of the pitch angle information and the information about the bump1260, the processor 270 can control the display 251 to change an ARgraphic object.

Referring to FIG. 12A, the AR camera 225 can capture a forward viewimage with a preset FOV. Reference numeral 1201 indicates a partialregion of an image that is captured in a vertical direction with a FOVof the camera 310, and reference numeral 1202 indicates a before-changecropping region with reference to the vertical direction. The processor270 can crop one part of the forward view image, and control the display251 to output an image 1231 corresponding to the crop area.

A pedestrian 1200 may be located ahead of the vehicle 100. When thefront wheels of the vehicle 100 passes over the bump 1260, if a drivingsituation is not reflected, the user interface apparatus 200 may providea user with information about the pedestrian 1200.

Referring to FIG. 12B, the processor 270 can change a crop area.Reference Numeral 1203 indicates a changed crop area. The processor 270can receive information about the bump 1260 from the navigation system770 or the object detection apparatus 300 through the interface unit245. If a pitch angle is changed upward when the front wheels of thevehicle 100 pass the bump 1260, the processor 270 can receive pitchangle information indicating the upward change of the pitch anglethrough the interface unit 245.

The processor 270 can also change a crop area on a forward view image bymoving the crop area downward on the forward view image, based on atleast one of the pitch angle information and the information about thebump 1260. Further, the processor 270 can control the display 251 todisplay an image 1232 corresponding to the changed crop area. Theprocessor 270 can control the display 251 to display a new AR graphicobject 1222, based on at least one of the pitch angle information andthe information about the bump 1260. In addition, the graphic object1122 may correspond to the new AR graphic object 1222 which is presentin an image 1232 which is displayed on the display 251 due to the changeof the crop area.

FIGS. 13A and 13B are diagrams illustrating an operation of a userinterface apparatus according to an embodiment of the present invention.Referring to FIG. 13A, the processor 270 can control the display 251 todisplay a graphic object based on various types of information or data.For example, the processor 270 can control the display 251 to displayAudio Video (AV)-relevant graphic object 1320 and news-relevant graphicobject 1330 in addition to a cropped image 1310.

The processor 270 can change a crop area based on information receivedthrough the interface unit 245. For example, the processor 270 cancontrol a crop operation based on a user input received through theinput device 210. The processor 270 can also control a crop operationbased on a user input, received through the input device 210,preferentially rather than information received through the interface.For example, if a first user input for stopping changing a crop area isreceived through the user input device 210 while a steering input isreceived, the processor 270 can stop changing the crop area.

Referring to FIG. 13B, if a user input is received through the inputdevice 210 even when any information is not received through theinterface unit 245, the processor 270 can control changing a crop area.For example, if a second user input is received through the input device210 while any information is received through the interface unit 245,the processor 270 can change the size of a crop area.

In addition, the processor 270 can increase the size of the crop areabased on the second user input. For example, the processor 270 candecrease the size of the crop area based on the second user input. Theprocessor 270 can change the size of the crop area in at least onedirection among an up direction, a down direction, a left direction, anda right direction.

Next, FIG. 14 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present disclosure.Referring to FIG. 14, the processor 270 can control the display 251 todisplay an image of a crop area. The processor 270 can control thedisplay 251 to overlay a carpet image 1410 or a TBT image 1420indicative of a scheduled moving direction on a lane 1400 present in thecrop area. When indicating a scheduled direction of travel of a vehicle,the carpet image 1410 may be defined as an AR graphic object whichappears rolled out on a roadway. In addition, the TBT image 1420 may bedefined as an AR graphic object which is an arrow indicative of ascheduled moving direction.

In addition, the processor 270 can receive driving situation informationthrough the interface unit 245 and change a crop area based on thedriving situation information. The processor 270 can also control thedisplay 251 to display an image of the changed crop area. Based on thedriving situation information, the processor 270 can control the display251 to change the carpet image 1410 or the TBT image 1420.

As illustrated in FIG. 14, when there is a change in at least one of aleftward steering angle, a leftward yaw angle, and a leftward headangle, the processor 270 can change a crop area. In this instance, basedon the change in a change in at least one of the leftward steeringangle, the leftward yaw angle, and the leftward head angle, theprocessor 270 can move the carpet image 1410 or the TBT image 1420 tothe right side, from a user's perspective, on the screen of the display251.

FIG. 15 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention. Referringto FIG. 15, the processor 270 can control the display 251 to display animage of a crop area and control the display 251 to overlay a highlightimage 1520 on a moving object 1510 present in a crop area. The highlightimage 1520 may be defined as an AR graphic object displayed in thevicinity of the moving object which a user needs to watch out.

The processor 270 can also receive driving situation information throughthe interface unit 245 and change a crop area based on the drivingsituation information. The processor 270 can control the display 251 todisplay an image of the changed crop area and can control the display251 based on the driving situation information to change the highlightimage 1520.

As illustrated in FIG. 15, if there is a change in at least one of aleftward steering angle, a leftward yaw angle, and a leftward headingangle, the processor 270 can change a crop area. In this instance, basedon the change in at least one of the leftward steering angle, theleftward yaw angle, and the leftward heading angle, the processor 270can move the highlight image 1520 to the right side, from the user'sperspective, on the screen of the display 251.

Next, FIG. 16 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention. Referringto FIG. 16, the processor 170 can control the display 251 to display animage of a crop area. The processor 270 can control the display 251 tooverlay a wall image 1610 on a line 1600 present in the crop area. Thewall image 1610 may be defined as a three-dimensional (3D) graphicobject which is present on the line 1600 to guide a host vehicle totravel in the inside lane.

The processor 270 can also receive driving situation information throughthe interface unit 245 and change the crop area based on the drivingsituation information. Further, the processor 270 can control thedisplay 251 to display an image of the changed crop area and control thedisplay 251 based on the driving situation information to change thewall image 1610.

As illustrated in FIG. 16, if there is a change in at least one of aleftward steering angle, a leftward yaw angle, and a leftward headingangle, the processor 270 can change the crop area. In this instance,based on the change in at least one of the leftward steering angle, theleftward yaw angle, and the leftward heading angle, the processor 270can move the wall image 1610 to the right side, from a user'sperspective, on the screen of the display 251.

FIG. 17 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention. Asillustrated in reference numeral 1710, the processor 270 can divide thedisplay 251 into a plurality of zones to display various kinds ofcontents. In more detail, the display 251 may be divided into first,second, and third zones 1701, 1702, and 1703. The processor 270 can thendisplay an image of a crop area in the second zone 1702 of the display251.

The processor 270 can display entertainment content and news content inthe first zone 1701 of the display 251. The processor 270 can displayweather content in the third zone 1703 of the display 251. Asillustrated in reference numeral 1720, the processor 270 can receiveinformation about at least one of a leftward steering angle, a leftwardyaw angle, and a leftward heading angle.

The processor 270 can expand a crop area to the left side, and controlthe display 251 to display an object 1721 in at least part of the thirdzone 1703. In this instance, the existing displayed weather content maydisappear. Further, The processor 270 can control the display 251 todisplay the object 1721 in the third zone 1703 along with the existingdisplayed content. In this instance, the processor 270 may process theexisting displayed content to have a specific transparency. In addition,the processor 270 may process the object 1721 to have a specifictransparency. The object 1721 may be located along a scheduled travelpath of a vehicle.

As illustrated in reference numeral 1730 the processor 270 can change acrop area on a forward view image by moving the crop area leftward onthe forward view image, based on information about at least one of aleftward steering angle, a leftward yaw angle, and a leftward headingangle.

The processor 270 can control the display 251 so that an AR graphicobject 1733 corresponding to the object 1721 present in the changed croparea is displayed in an overlapping manner. The processor 270 canreceive information about at least one of a rightward steering angle, arightward yaw angle, and a rightward heading angle.

In addition, the processor 270 can expand a crop area to the right sideand control the display 251 to display an object in at least part of thefirst zone 1701. In this instance, the existing displayed entertainmentand news contents may disappear. Then, the processor 270 can change thecrop area by moving the crop area rightward on the forward view image,based on the information at least one of the rightward steering angle,the rightward yaw angle, and the rightward heading angle. The processor270 can also control the display 251 to overlay an AR graphic object,corresponding to an object, on the changed crop area.

Next, FIG. 18 is a diagram illustrating an operation of a user interfaceapparatus according to an embodiment of the present invention. Referringto FIG. 18, the processor 270 can expand or reduce a crop area based ondriving situation information. For example, the processor 270 can expandor reduce a crop area based on a speed of the vehicle 100. For example,the processor 270 can expand or reduce a crop area based on informationabout at least one of a steering angle, a yaw angle, and a headingangle. As illustrated in reference numeral 1810, the display 251 may bedivided into first and second zones 1801 and 1802.

The processor 270 can display an image of the crop area in the secondzone 1802 of the display 251. Further, the processor 270 can displayentertainment content and news content in the first zone 1801 of thedisplay 251. As illustrated in reference numeral 1820, the processor 270can receive information about at least one of a rightward steeringangle, a rightward yaw angle, and a rightward heading angle. In thisinstance, the processor 270 can expand the crop area to the right side,and control the display 251 to display the image of the expanded croparea. In this instance, the existing displayed entertainment content maydisappear.

The processor 270 can control the display 251 to display an image of theexpanded crop area in the first zone 1801 along with an existingdisplayed content. In this instance, the processor 270 can process theexisting displayed content to have a specific and also process the imageof the expanded crop area to have a specific transparency.

Further, the processor 270 can determine a degree of expansion of acropped image in proportion to at least one of the steering angle, theyaw angle, and the heading angle, and can determine the number ofcontents to disappear, depending on the degree of expansion of the croparea.

The present invention as described above may be implemented as code thatcan be written on a computer-readable medium in which a program isrecorded and thus read by a computer. The computer-readable mediumincludes all kinds of recording devices in which data is stored in acomputer-readable manner. Examples of the computer-readable recordingmedium may include a hard disk drive (HDD), a solid state disk (SSD), asilicon disk drive (SDD), a read only memory (ROM), a random accessmemory (RAM), a compact disk read only memory (CD-ROM), a magnetic tape,a floppy disc, and an optical data storage device. In addition, thecomputer-readable medium may be implemented as a carrier wave (e.g.,data transmission over the Internet). In addition, the computer mayinclude a processor or a controller. Thus, the above detaileddescription should not be construed as being limited to the embodimentsset forth herein in all terms, but should be considered by way ofexample. The scope of the present invention should be determined by thereasonable interpretation of the accompanying claims and all changes inthe equivalent range of the present invention are intended to beincluded in the scope of the present invention.

Although embodiments have been described with reference to a number ofillustrative embodiments thereof, it should be understood that numerousother modifications and embodiments can be devised by those skilled inthe art that will fall within the spirit and scope of the principles ofthis disclosure. More particularly, various variations and modificationsare possible in the component parts and/or arrangements of the subjectcombination arrangement within the scope of the disclosure, the drawingsand the appended claims. In addition to variations and modifications inthe component parts and/or arrangements, alternatives uses will also beapparent to those skilled in the art.

What is claimed is:
 1. A user interface apparatus for a vehicle,comprising: an interface unit; a display; and a processor configured to:display a cropped area of a forward view image on the display in whichan object is present in the displayed cropped area, display a firstaugmented reality (AR) graphic object overlaid onto the object presentin the displayed cropped area, change the cropped area based on drivingsituation information received through the interface unit, and changethe first AR graphic object based on the driving situation information,wherein the forward view image is received through the interface unit,wherein the processor is further configured to: display a wall imageoverlaid on a line present in the cropped area, and change a position ofthe wall image based on the driving situation information, wherein thewall image is a three-dimensional (3D) graphic object which is presenton the line to guide a host vehicle to travel inside a lane, wherein theprocessor is further configured to: receive information about a bumplocated ahead of the vehicle through the interface unit, receive pitchangle information indicating an upward change of a pitch angle throughthe interface unit, change the cropped area by moving the cropped areadownward on the forward view image based on at least one of the pitchangle information and the information about the bump when front wheelsof the vehicle pass the bump, and based on at least one of the pitchangle information and the information about the bump, change the firstAR graphic object, and wherein the first AR graphic object correspondsto a new object present in an image displayed on the display due to thechange of the cropped area.
 2. The user interface apparatus according toclaim 1, wherein the processor is further configured to: set a centerpoint in the cropped area; and change a center point in the forward viewimage based the driving situation information.
 3. The user interfaceapparatus according to claim 1, wherein the processor is furtherconfigured to: receive steering angle information through the interfaceunit, and based on the steering angle information, change the croppedarea on the forward view image by moving the cropped area leftward orrightward on the forward view image.
 4. The user interface apparatusaccording to claim 1, wherein the processor is further configured to:receive yaw angle information through the interface unit, and based onthe yaw angle information, change the cropped area on the forward viewimage by moving the cropped area leftward or rightward on the forwardview image.
 5. The user interface apparatus according to claim 1,wherein the processor is further configured to: receive heading angleinformation through the interface unit, and based on the heading angleinformation, change the cropped area on the forward view image by movingthe cropped area leftward or rightward on the forward view image.
 6. Theuser interface apparatus according to claim 1, further comprising: aninput device configured to receive a user input, wherein the processoris further configured to: stop changing the cropped area based on afirst user input.
 7. The user interface apparatus according to claim 6,wherein the processor is further configured to, based on a second userinput, change a size of the cropped area.
 8. The user interfaceapparatus according to claim 1, wherein the processor is furtherconfigured to: display an overlaid carpet image or a turn-by-turn (TBT)image indicative of a scheduled moving direction on a lane present inthe cropped area, and in response to the changing of the cropped area,change a position of the carpet image or the TBT image.
 9. The userinterface apparatus according to claim 1, wherein the processor isfurther configured to: display a highlight image overlaid on a movingobject present in the cropped area, and in response to the changing ofthe cropped area, change a position of the highlight image.
 10. The userinterface apparatus according to claim 9, wherein the processor isfurther configured to, based on the driving situation information,change a size or a color of the highlight image.
 11. The user interfaceapparatus according to claim 1, wherein the processor is furtherconfigured to: receive steering angle information through the interfaceunit, based on the steering angle information, display an object presenton a scheduled travel path of the vehicle, and change the cropped areaon the forward view image by moving the cropped area leftward orrightward on the forward view image based on the steering angleinformation, and display an AR graphic object, corresponding to theobject, overlaid on the changed cropped area.
 12. The user interfaceapparatus according to claim 1, wherein the processor is furtherconfigured to expand the cropped area based on the driving situationinformation.
 13. The user interface apparatus according to claim 1,wherein the processor is further configured to: receive informationabout a curve located ahead of the vehicle through the interface unit,change the cropped area by moving the cropped area leftward or rightwardbased on the information about the curve, and based on the informationabout the curve, change the first AR graphic object.
 14. The userinterface apparatus according to claim 1, wherein the processor isfurther configured to: receive a rear view image of the vehicle throughthe interface unit, crop a part of the rear view image, display an ARgraphic object, corresponding to a cropped area of the rear view image,overlaid on an image of the cropped area of the rear view image, changethe cropped area of the rear view image based on information about asteering angle received through the interface unit, and based on theinformation about the steering angle, change an AR graphic objectcorresponding to the cropped area of the rear view image.
 15. The userinterface apparatus according to claim 1, wherein the processor isfurther configured to: receive information about a steering anglethrough the interface unit while at least one content is displayed in afirst zone of the display, based on the information about the steeringangle, display an image of the cropped area expanded into at least partof the first zone, and determine a degree of expansion of the image ofthe cropped area in proportion of a size of the steering angle, and anumber of contents to disappear from the first zone depending on thedegree of expansion of the image of the cropped area.
 16. A vehiclecomprising a user interface apparatus according to claim 1.